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10.0 INTRODUCTION 


This unit is concerned with the approximation of certain “ well-behaved” functions 
of one real variable by polynomial functions which exhibit a particular pattern. It 
discusses the question: given a function f and its image and derivatives at a point a 
in its domain, what can we say about the image f(x), where x is “near to” a? 


The unit introduces the general Taylor approximation of degree n for a function f 
which possesses derived functions, f’, f”, f, ..., f. This approximation expresses 
f(x) as a polynomial of degree n in (x — a), with coefficients which involve only real 
numbers and the derivatives of f at a. 


The core material begins by discussing the linear Taylor approximation (i.e. the tan- 
gent approximation) and the quadratic Taylor approximation. The pattern which 
emerges leads us to consider the general Taylor approximation of degree n. We find 
that, knowing f(a), f’(a), ..., f@ f*”, we can say something useful about f(x), 
where x is “near” a. This leads us to discuss what we mean by “ near”’ i.e. the validity 
of the Taylor approximation. In section 10.1.4 we discuss the error in the tangent 
approximation and give an expression for the error bound, and indicate the error 
analysis for the general case. We find that, in many cases, to stay within a particular 
error bound we have to place a restriction on x. 


The optional material falls into three main parts. 


rc 


In sections 10.2.1 and 10.2.2 we take up the discussion of iterative methods of solving 
equations, and we answer some of the questions raised in our discussion of iterative 
methods in Units J and 2. In section 10.2.1 we consider sufficient conditions for the 
convergence of an iterative method. In section 10.2.2 we consider a particular iterative 
method, called the Newton-Raphson method. 


In section 10.2.3 we extend our earlier work on the convergence of infinite series and 
consider power series, that is, series of the form 


ao + a,(x — a) + a,(x — a)’ +a,(x — a)? ++ 
The convergence of such a series usually depends on the value assigned to the 


variable x. In section 10.2.4 we consider Taylor’s series and its convergence. 


Finally, in section 10.2.5, we return to the problem of the location and determination 
of the local extrema of functions of two real variables. We use Taylor’s series (for 
one real variable) to derive a test for the determination of the nature of these extrema. 
(See Unit 7, section 7.1.7, Note c(4).) 
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10.1 CORE MATERIAL 
10.1.1 The Tangent Approximation 
(a) Purpose 


To explain how a differentiable function f of one real variable can be approximated 
in the neighbourhood of a point a in its domain by a linear function whose graph is 
the tangent to the graph of f at a. 


(b) Set Book 


Read section 2.5.0 (p.115). Study section 2.5.1 (pp.115-119) and complete Exercises 
1 and 2. 


(c) Notes 


(1) We met the geometrical interpretation of the derivative of f at a as the tangent 
to the graph of f at a in section 1.8.2 (pp.177-178). 


(2) Let t be the tangent approximation to f about x = a; i.e. 
t:x ———> f(a) + (x —a)f'(@). 
Then the derived function of t is 
t': x -—> f(a). 
Hence 
t(a) = f(a) (i) 
and 
t'(a) = f(a). (il) 
Conversely, let t be a linear function, 
t:x-—> 5b, + bx (x € R). 


Then t is the tangent approximation to f at a if the graph of t passes through the 
point (a, f(a)), i.e. 


t(a) = by + bya = f(a), (i) 
and the slopes of the graphs of f and t at a are the same, i.e. 
t'(a) = b, = f'(@). (ii) 


From equation (i), we have 
bo = f(a) — bya; 
hence, from equation (ii) it follows that t is the function 
t:x-—> f(a) + f’(a(x — a) (x € R). 
This result is in agreement with Equation (1) on p.118. 


(The importance of this approach stems from the fact that it can be generalized 
to derive higher order polynomial approximations. We shall consider these in 
sections 10.1.2 and 10.1.3.) 


We have seen that equations (i) and (ii) completely determine the tangent ap- 
proximation to f about x = a, and conversely. 


(3) Iftis the tangent approximation to f about x = a, then 


hm (F(x) — «x)) =f@ — t(@) = 0, 


by equation (i). 


(4) 
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Also, 


pa Oe 


xa See ° | x~7a » Be | | 


nile a 
x~7a X—@ 
=f"(a)-f'@ 
= (). 
We now have the two results: 
lim ( f(x) - t(x)) == Q (iii) 
and 
fig == Q. (iv) 


xa ecm ©: 


Conversely, if t is any linear function which satisfies equations (iii) and (iv), then, 
from equation (iii), it follows that 


f(a) = ta), 
since f and t are continuous at a. 


We may write equation (iv) in the form 


mf =L@ = (t@) = 1@) _ 


li 0, 
x~7a A= a 
i.e. | 
_ K(x) — Ft 
eo te OO 8g. 
xa : a x~7a a a 
hence 


f'@ = t@). 
Hence t is the tangent approximation to f about x = a. (See Note (2)). 


Consequently, t is the tangent approximation to f about x =a if and only if 
equations (iii) and (iv) are satisfied. (Again, these results can be generalized for 
higher order polynomial approximations.) 


Equation (iv) gives us an upper bound on the difference | f(x) — t(x)| between 
the actual value of the function f at x and the approximate value given by t(x), 


: x) —t(x 
when x is “‘near’”’ a. Because gn 
x~va A @ 


= 0, then, for x sufficiently near a, 


f@)- | | 


|x —a| 
(otherwise the limit could not be zero). Hence 


If) — t)| <|x—-al, (v) 
for x sufficiently near a. 


If we define the error in the approximation at x to be the difference | f(x) — t(x)|, 
then inequality (v) gives an upper bound on the error, provided x is near a. 
In the special case when we consider the tangent approximation to f about x = 0, 
inequality (v) becomes 


[f(x) — t(x)| < |x]. 


Of course, the phrase “‘ x sufficiently near a”’ is very vague, but errors in approxi- 
mations will be considered more rigorously in section 2.5.6. 


MST281 10.1.1 


(d) Self-Assessment Questions 


1 Derive an expression for the error in approximating the function 
fies x ie R*) 


over an interval [a — 6,a+6]<&R* by the tangent approximation at the point 


(a, f (a). 
2 Derive an expression for the error in approximating the function 
| 
ii : (x € R*) 
over an interval [a — 6,a +6] R* by the tangent approximation at the point 
(a, f(a). 
3 Use your results for questions 1 and 2 to show that, in each case, 


; 2 maximum value of 
error <4|x —a|* x 


|[f"(x)| in [a — 6, a+ 6] 


Solutions 


1 The derived function of f is 
f' 1x ——> 3x” (xe R*), 
so the tangent approximation at (a, f(a)) is 
t:x-—» a? + (x—a)3a”__—s (xe R'*). 
The error in the approximation is 
f(x) — t()| = |x* — a® — (x — a)3a?|. 
If x e [a — 6, a+ 6], then we can write x = a+, where e€ [—6, 5]. Thus 
error = |(a + ¢)® — a? — £3a’| 
= |3ae” + e°| 
= |3a + ele”. 


2 The derived function of fis 
] 
eee (xe R*). 


As in question 1, we can write x = a + e, where ¢ € [—6, 5]. We have 
error = | f(x) — t(x)| 


1 Lt @ 
(at+e) a a? 


2 


(a + €)a? 


e? 1 
2 


=-—-—— X a 
a la+e| 


3 (i) In question 1, 
Sf" sx —> 6x (x € R*), 
SO 


- > maximum value of 
y ix ee a| x 


\f"(x)| in [a — 6, a+ 6] 
iS 
te x 6(a + 6) = (3a + 35)e?. 
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From question 1, 
error = |3a + e|¢ 
< |3a + |e||e?. 
Since 6 > 0, and |e| < 6, it follows that 


maximum value of 
error < $|x— a)? x ( : —— ) 


| f"(x)| in [a — 6, a+ 6] 


(ii) In question 2, 


2 
oe Sena (x € R*), 


SO 
maximum value of 


eles ben ei chase 


= 2 sg” 
SE eg a ares 
2 (a—6) (a-—6d) 
From question 2, 


7 


error = —————- 
a*|a+eé| 

< a 
ee = oy 


Since 5 > 0 and a> 0, it follows that a?(a — 5) > (a — 5)’, and therefore 
sre ao? x maximum value of 
—e | f"(x)| in [a—-6,a+6]} 
(e) Terminology 
Defined in this section: 


linear Taylor approximation (tangent approximation) 


(f) Additional Exercise (OPTIONAL MATERIAL) 

Use the tangent approximation to compute the following values: 
(i) (25.018)'/2 

(ii) sin 29° 

Solution 


(i) We use the tangent approximation t to f: x ———> x'/* about x = 25. 


Then <= 
t: x -———» ./25 + (x —25)f'(25) (xe R*). 
Now 
1 
a ae 


and so f’(25) = 1/10. 


Hence 
t:x-——> 5+ (x — 25) 
and 
(25.018) = 5 + sy (0.018) 
= 5+ 0.0018 
= 5.0018 


((25.018)'/? is 5.0017997 correct to 7 decimal places.) 
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(ii) sin 29° = sin (30 — 1)° = sin (7 A ah 


We use the tangent approximation t to f: x ———> sin x about x = 2/6. Then 


tix -——> sin(=) + (x —~ =) cos(=) (x € R) 


ie. 
tix t (xcorS) Xe 
whence 
— aa (5 ba? 
6 6 2 180/ 2 
= 0.4849 


(sin 29° is 0.4848 correct to 4 decimal places.) 


10.1.2 The Quadratic Taylor Approximation 


(a) Purpose 


To explain how a twice differentiable function f of one real variable can be approxi- 
mated in the neighborhood of a point a in its domain by a quadratic function q, 
dependent only upon f(a), f’(a) and f"(a). 


(b) Set Book 


Study section 2.5.4 (pp.122-124) and complete Exercise 1. Ignore the first two sentences 
of this section for the moment. (The relation between the iterative method and the 
linear Taylor approximation is discussed in the Optional Material, section 10.2.1.) 


(c) Notes 


(1) Instead of regarding the quadratic Taylor approximation as the limit of a quad- 
ratic through three equally spaced points (as we have done on p.123) we can start 
by requiring that the quadratic function 

gi: x-— bo + b,(x —a) + b,(x—a)* = (xe R) 


satisfies the conditions specified in Equations (1) (p.123). The derivation then 
follows that given, and is clearly a simple generalization of that given in section 
10.1.1, Note c(2). 


The equations 


q(a) = f (a) (i) 

q (a) =f'(@) (il) 

q'(a) =f"(@) (ili) 
completely determine the quadratic Taylor approximation to f about x = a, and 
conversely. 


If you are interested in establishing the equivalence between the geometrical and 
algebraic interpretation of the quadratic Taylor approximation, then you can 
study the method described in section 2.7.7, page 228, to fit a quadratic to the 
points (a, f(a)), (a + h, f(a + h)) and (a + 2h, f(a + 2h)). The required quadratic 
is given by Equation (5), page 229, where x, = a, X%,4, =a+handx,,, =a + 2h. 
Taking the limit as A approaches zero, and using the definitions of f’(a) and f"(a), 
it can be shown that Equation (5) on page 229 reduces to the quadratic Taylor 
approximation. This demonstrates the validity of the intuitive argument given 
on page 123. 


(2) Ifq is the quadratic approximation to f about x = a, then it can be shown that 


lim f(x) — q(x) = 0 


 (-). 
xa X—a 
tim — 9) _ 


xa (x— a)” 


Conversely, if g is the quadratic function which satisfies equations (iv), (v) and 


(vi), then it can be shown that 


q:x+——> f(a) + (x — a) f(a) + 4x — a)’ f(a). 


Consequently g is the quadratic Taylor approximation to f about x = a if and 


only if equations (iv), (v) and (vi) are satisfied. 


(3) Equation (vi) gives us an upper bound for the error | f(x) — q(x)| in the quad- 


ratic Taylor approximation. 
Since 


er i (x) — q(x) 


= 0, 
x~7™a (x ane “(x=—a)*- 


then, for any small positive number e, it must be possible to find a positive number 


6 such that 
fx) = a@)| 


(x — a)? 


whenever x € [a — 6,a + 6d]. 


Hence 

IF) — 9)| < e|x - a)’. 
Taking e = 1, we have 

IF) — g)| < |x —al?, 


for all x sufficiently “‘ near’”’ a. 


(d) Self-Assessment Questions 
1 Derive an expression for the error in approximating the function 


f:x—— x? (xe R*) 


over an interval [a — 6, a + 6]< R® by the quadratic Taylor approximation at the 


point (a, f(a)). 


2 Derive an expression for the error in approximating the function 


1 
eam: < (x € R*) 


over an interval [a —6,a+6]¢ R* by the quadratic Taylor approximation at the 


point (a, f(a)). 
3 Use your results for questions 1 and 2 to show that, in each case, 


amie | ‘eel maximum value of 
Sox 7 | f(x)| in [a — 6, a+ 6]] 


4 Calculate an approximation to (1.14)'/? by 


(i) the tangent approximation; 
(ii) the quadratic Taylor approximation. 


Compare your answers with the correct value, which is 1.067708 (correct to 6 


decimal places). 
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Solutions 
1 The first and second derived functions of f are 
f' :x-——> 3x” (xe R'*), 
f" :x-— 6x (x € R*) 
respectively. 
The quadratic Taylor approximation at (a, f(a)) is 
qi: x-— a? + (x — a)3a*7+4(x-a)’6a_—Sss (xe R*). 
The error in the approximation is 
IF) — 9) = |x° — a* — (x — a)3a* — 4(x — a)’6a. 


If x € [a — 6,a + 6], then we can write x = a+e, where ee [—), Od]. The error 
then becomes 


|\(a + «)? — a? — &3a* — te*6a| = |e|?. 


2 The first and second derived functions of f are 


ee ixeR"} 


respectively. 


The quadratic Taylor approximation at (a, f(a)) is 
1 ae 2 
pao; - 2-8 ed (xe R*): 
The error in the approximation is 


eee 1 1 
fo) — a) =|=-2 + (xa) Gea)? 5 


If xe [a —6,a+ 0], then we can write x =a+e, where ¢e€[—0, 6]. The error 
then becomes 


1 ae er 
ee 


a+eé a a a 


Hg 
la+e| 


a 
3 (i) In question 1, 
ff x —> 6 (se R*). 
Ye) 


l | aiP% maximum value of 
3! |f(x)| in [a — 6, a+ 6] 


is 
Lel> x 6 = |e? 
Hence, in this case, 


error = i | Me ie a\|* x maximum value of 
3! |f(2)| in [a — 5, a + 5]) 


(ii) In question 2, 
6 
_ eo “a (xe R*), 


SO 


] | es maximum value of 
aa [f(@)| in [a -— 6, a + 5] 
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:. 6 s" 
—-€E X Peres 5 | = = a . 
6 (a—od)” (a—d) 
From question 2, the error is 
4 

ate 


é 


a 
Since 6 > 0 and e> — 6, 


a*(a + &) > (a — 5)*, 


hence 
error < x Ix — al? x ( maximum value of 
“3! |f(@)| in [a — 6, a + 8] 
4 If 
fi x— x1? (x e R, x #0), 


then the tangent approximation about x = 1 is 
t:x-—> 1+4(x- 1) (xe R, x #0), 
whence 
r(1.14) = 1+ 40.14) 


= 1+ 0.07 
== 1.07 
The quadratic Taylor approximation about x = 1 is 
P (x — 1)? " 
q:x-— > fil) +(x -— Df’) + 5 7 tis 
Now 
| 
Ge rae = (xe R, x #0) 
1 
Se oe (xe R, x #0) 
and so 
FAD = —4%, 
giving 


q:x-—> 14+4(x-1)-40- 1)’, 
q(1.14) = 1 + 4(0.14) — 30.14)? 

= ] + 0.07 — 0.00245 

= 1:06755 


We see that the quadratic Taylor approximation is more accurate for this value of 
x than the tangent approximation. 

(e) Terminology 

Defined in this section: 


quadratic Taylor approximation 


(f) Additional Exercises (OPTIONAL MATERIAL) 
1 Use the quadratic Taylor approximation to calculate an approximation to cos (31°). 
2 Find the quadratic Taylor approximation to the function 
fix-— 3x*-x+6 8 §86(xeER) 
about the point x = —1. 


What do you notice? 
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Solutions 


es 
1 cos (31°) = cos (; + a) 
Let 
f :x-— cos x (x € R). 
Then 
f':x-—— -sin x (x € R) 


" x-—> — COSX (x € R) 


and so the quadratic Taylor approximation about x = 


5 is 
cI) b-Bee-O0 
a(5 = ao) SE ane: : BAS 


Tt 
0.8572 
a(Z > x) = : 


(to four decimal places) and in fact this is the correct value to four decimal places. 
2 We have | 
fi: x-—> 3x? -x+6 = 8©6((xeER) 


Thus 


f':x-—— 6x - 1 (x € R) 
f":x-— 6 (x € R) 
so the quadratic Taylor approximation about x = —1 is 
i i 
qix-—— f(-1I + @+ D/'(-) + — fC D 
i. 
+ 1) 
gixr—+ 10+ (x + (- + S26 
Le. 
x—— 10 — 7x — 7+ 3x? + 6x +3 
1:e. 


xir——— 3x? —x+6 8 8(xe R). 
This is the same as the original function. 


This should come as no surprise because both f and q are quadratics with 


I(-1) = a3) 
I(-)= es 
fiers 


and as we observed earlier, equations (i)-(iii) in Note c(1) completely determine 
the quadratic approximation. 
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10.1.3. The General Taylor Approximation 


(a) 


Purpose 


To explain how an n-times differentiable function f of one real variable can be approxi- 
mated in the neighbourhood of a point a in its domain by a polynomial function of 
degree n. : 


(b) 


Set Book 


Study section 2.5.5 (pp. 124-129) and complete Exercises 1, 2 and 3. If you are short 
of time, omit Exercise 2 and all but the last part of Exercise 3. 


(c) 
(1) 


(2) 


(3) 


(4) 


(d) 


Notes 


The geometrical interpretation of the general Taylor approximation is analogous 
to those of the tangent and quadratic approximations. (See Note c(2) in section 
10.1.1 and Note c(1) in section 10.1.2.) If a polynomial is fitted to the function f 
at (n + 1) equally spaced points 

a,at+th,a+2h,...,a+nh, 
and the limit as ) approaches zero is taken, then the expression obtained for f(x) 
is the Taylor approximation of degree nm. Since the manipulation involved in 


this derivation is very tedious, you are advised not to attempt to derive this 
result for yourself. 


Note that the Taylor approximation of degree n is characterized by the equations 


p(@) = f(a) 
p'(a) =f'@) 
p'(@) =f"@ 


p™(a) = f(a). 


The Taylor approximation of degree n satisfies these equations and, conversely, 
any polynomial of degree n which satisfies these equations is the Taylor approxi- 
mation of degree n. (See Note c(2) in section 10.1.1, Note c(1) and Additional 
Exercise 2 in section 10.1.2.) 


It can be shown that 


ee og oo 2 
|x —a| 


xa 


where p(x) is the Taylor approximation of degree n. This follows from the 
(n + 1) equations listed in Note (2) above. 


Exercise 3 and its solution (p. 129 and pp. 148-150) brings out two important 
points. First, for some functions the Taylor approximation is exact if n is large 
enough. If 


ff: x-— (ax + Db)” (x € R) 


(né Z*), then the Taylor approximation of degree n about x = 0 is in fact the 
binomial expansion of (ax + b)". (See Unit 2, section 2.3.3.) 


Second, for some functions the Taylor approximation about the point a is only 
reasonable within a limited neighbourhood of a. We must examine carefully the 
extent of the region in which we can use p(x) as an approximation to /(x). 
This point is taken up in sections 10.1.4 and 10.2.4. 


Self-Assessment Questions 


1 Let f be the polynomial function 
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f ixr——> x* — 5x? -2x +4 (xe R). 
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Find values of the constants cy, C,, C2, C3 such that f may be specified in the form 
f 1X-— Cp + (x — 2) + 0,(x — 2)? +0;(x-— 2)? (xe R). 


2 Derive an expression for the error in approximating the function 
I == 
fixe - (xe R*) 
x 


over the interval [a — 6, a + 6],a > 6 > 0, by a Taylor approximation of degree n. 


Solutions 
1 We have 
f ix—> x? — 5x* — 2x + 4 (x € R), 
f': x -——+ 3x? — 10x — 2 (x € R), 
ff": x-— 6x — 10 (x € R), 
f:x-— 6 (x € R) 
{™:x-— 0 (xe R),n>4. 


This means that the Taylor approximation of f about any point a in its domain 
terminates after four terms. So the required expression is the Taylor approximation 
of degree n > 4 about x = 2. Hence 


Co = f(2) = -—12 
¢, =f'(2) = —10 
c, =3f"(2)=1 


5 = BFR) = 1. 


2 The derived functions of f are 


f'ix-— -5 eR >. 
fies (x e R*), 
fOrx—S = (x € R*) 
fs 9 SO (x € R*) 
{M:xe— nets fixe R*: 


Hence the Taylor approximation of degree n about a is 
1 Poass 2 
P(x) =— —(¥— a) G+ 5% — a) 


1 3x2 +1 ? <T nd 
=~ Seer 7 adress ee, yeti: 


Let x = a+, where ¢ € [—6, 6]. Then the required error is 


a SS 
lf(x) — Pr(x)| -|=5-(-3t3- i=) =| 
1 n+1 n a1 
=Groer |4 —(a+e)a"+(a+e)a" ‘é 
+-*-—(—1)"(a@ + &)e"| 
= ieee 
- (a+200""° 
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The maximum value of | f*?)(x)|, x € [a — 6, a + 6], is 


(n + 1)(—1)"*! (n + 1)! 


(a os oy = (a 4 eja"t i” 
Hence 
Ix—aj"*! 
Ti 
(a + ¢)a"*! 


= 1 x —a|*t <( maximum value of 
“(n+ 1)! [fO* @)| in [a —5, a + 6]) 


We shall see in section 10.2.4 that this result, which we have obtained for a special 
case, holds for any function f with continuous derived functions of orders 1,..., 
n+l. 

(e) Terminology 

Defined in this section: 


general Taylor approximation of degree n 


(f) Additional Exercise (OPTIONAL MATERIAL) 


Additional Exercise 3 (p. 144) provides an opportunity to revise the ideas discussed 
in this section. 


10.1.4 Error in the Tangent Approximation 


(a) Purpose 


To discuss an estimate of the error involved when a differentiable function fis approxi- 
_ mated by the tangent approximation in the neighbourhood of a point a in its domain, 
and to state (without proof) Taylor’s theorem for the tangent approximation. 


(b) Notes 


(1) In sections 10.1.1-10.1.3 we have defined the error in an approximation as the 
quantity 


|exact value — approximation|. 

In this section the error is defined as the signed quantity 
approximation — exact value, 

and its negative 
exact value — approximation, 

is called the correction to the approximation. 


(2) From the self-assessment questions in section 10.1.1, we have already found the 
error in the tangent approximation for two simple functions, and we have found 
an expression which gives an upper bound on this error. The aim of section 2.5.6 
is to extend this result to the general Taylor approximation. 


(c) Set Book 
Study section 2.5.6 (pp. 130-134) and complete Exercises | and 2. 


(d) Notes 


(1) The result given on p. 131 (Inequality (1)) corresponds to the result which we 
established for two particular cases in the self-assessment questions of section 
10.1.1. This is the statement of Taylor’s theorem for the tangent approximation, 
namely that, if 


IFO <B (te [a, x), 
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then 
|C,(x)| = | f(%) -£@ — (x — a) f'@| < 4x — a)B. 


We shall demonstrate the validity of Taylor’s theorem for this particular case. 
(Taylor’s theorem for the general nth degree polynomial approximation is dis- 
cussed in section 2.5.7.) 


Let us consider the case x > a. We define the function 
Cy:t-—>- fY™-Y@+t-a@f@] (tela, x). 
The first and second derived functions of C, are 
Ci:tr——-f'O-f@ (tela, x)), 
Ci: tr— f(t) (t € [a, x]). 
Suppose that there exists a positive number B such that 
\F"O| <B (te [a, x). 
Then, since Ci(t) = f"(t) and C{(t) < |C{()|, we have 
Ci() < B (t € [a, x]). 
We now integrate the above inequality from a to s, where s € [a, x]. We obtain 


[p—cw< [1 


a a 


By the Fundamental Theorem of Calculus (Unit 5), it follows that 
i(s) — Cy(@) < Bis — a), 

since C’, is a primitive of C{. But C{(a) = 0, so we have 
105) < Bis — a). 

Since this inequality holds for all s in [a, x], it follows that 
i(t)< Bit—a) = (te [a, x)). 


We now repeat the procedure and reduce the order of the derivative one further. 
Integrating this inequality from a to s, we obtain 


{i os 0 < | ee Oak 


By the Fundamental Theorem of Calculus, we now have 
C,(s) — C,(a) < $B(s—a)* (se [a, x]). 
C,(a) = 0, so we have 
C,(s) <4B(s—a)’ = (se [a, x]). 
Similarly, starting with —C{(t) < |C{(t)| < B, we could obtain the inequality 
—C,(s)<4B(s—a)* (se [a, x]). 
It follows that 
|C,(s)| <4B(s— a)? (se [a, x]). 


A similar demonstration applies for x <a. The general Taylor theorem may be 
demonstrated similarly. (See section 2.5.7.) 


The fact that we can place an upper bound on our error does not imply that the 
error is small. When we use the tangent approximation in a particular case, we 
must find the value of this upper bound in order to see if the error is acceptable. 
(See Example 1, p. 132.) 


Notice, however, that, since the error bound depends upon the quantity (x — a)’, 
we can make the error as small as we please by restricting x to a region close to 
the point a. 
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(3) Note that our result gives an alternative proof of the statement 
: Xx) — UX 
in FO =H)! 
x~7a |x Pa a| 


(See section 10.1.1, Note c(3).) 


0. 


For 
| F(x) — t(x)| = Cy) 


and therefore 


a ae 
in ee) oe oe 
x~7a lx —a| x~7a lx —a| 


(e) Self-Assessment Question 

Additional Exercise 4, section 2.5.9 (p. 144) provides practice in using the Taylor 
theorem for linear polynomial approximations to estimate the error in a linear 
approximation. 

(f) Terminology 

Defined in this section: 


error in an approximation 
correction to an approximation 
Taylor’s theorem for linear polynomial approximations 
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10.2 OPTIONAL MATERIAL 
10.2.1 The Convergence of an Iterative Method 


(a) Purpose 


To give a necessary condition for the convergence of the sequence generated using the 
recurrence formula 


U;, =e F(t, 1) (kK = 2, 3, 4, ceak 
where u, is an approximate solution of the equation 
x = F(x), 


and to discuss the conditions under which we can use such an iterative process for 
solving equations of the form 


F(X) = 0. 

(b) Note 

We started to consider the problem of solving equations of the form 
f(x) =0 


in Unit I (section 1.2.4, pp. 32-37) and Unit 2 (section 2.2.4, pp. 32-35). If you did not 
study these sections, then work through them before attempting to complete the 
work below. For convenience, we shall start this section by summarizing the results 
obtained so far. 


Given the equation f(x) = 0 with domain the real interval J, we define the function F 
by 

F:x-—> F(x) =f(x)+x (xel). 
We saw in section 1.2.4 that the following conditions ensure that F(x) =x has a 
solution in an interval [a, b] c J: 
(i) F has domain and codomain [a, 5]; 
(ii) Fis continuous on [a, b]. 


In section 2.2.4 we considered how to select a form for f(x) = 0 so that the sequence 
generated by iteration using the corresponding function F converges to a solution of 
f(x) = 0. We found that, if Fis a linear function, then the sequence converges provided 
that 


|the slope of the straight line graph of F| <1. 


In the following material, we shall extend this result to a general function F. We shall 
then go on to consider the problem of selecting the interval [a, b] so that it contains 
only one solution of the equation f(x) = 0. 


(c) Set Book 
Study section 2.5.2 (pp. 119-121) and complete Exercise 1. 


(d) Notes 


(1) Notice the distinction between necessary conditions (conditions which must 
hold if wu does have a limit), and sufficient conditions (conditions which ensure 
the existence of a limit for the iterative sequence). 


(2) Strictly speaking, the necessary condition produced takes it for granted that the 
function F is ‘‘ well-behaved’’, that is, it is the kind of function to which it is 
reasonable to apply the tangent approximation and which satisfies the conditions 
imposed in Note (b) above. All these requirements are certainly met if we assume 
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that F is differentiable throughout its domain; however, this condition is stronger 
than we need, as we show below. 


In section 1.2.4 we examined two forms of functional iteration for solving the 
equation x7 — 2=0. We can apply our test for convergence to these sequences. 


In problem 3 (p. 34), we examined a functional iteration based upon 
F:x——>x?-2+x (xe[-—24, 14)). 

The corresponding derived function is 
F’: x —— 2x + 1 (x € [—24, 14]). 

We have 
|F'(—./2)| = |2(—./2) + 1] > 1, 


so the iterative sequence will not converge to the root at ua (and this is the 
only root in the interval [— 24, 14]). 


In Exercise 2 (p. 35), we examined a functional iteration based upon 
— 
F: x -+ = (x € [1, 14]). 


The corresponding derived function is 
—1 


F'; x -—> — +5 
XxX 


go os (wreath: bgp. 


We have 


|F’(./2)| = |-4 +4] =0 <1, 


so the iterative sequence will converge to the root at es 2 (and this is the only root 
in the interval [1, 14). 


In section 2.5.2 we do not indicate how to obtain a sufficient condition for the 
convergence of the functional iteration. Our discussion in Units ] and 2 shows 
how to tackle this problem. We must find a condition which ensures that there is 
only one solution in the interval [a,b]. How can we find such a condition? 
What form will it take? | 


If F is differentiable on [a, b], then one condition that will certainly meet our 
requirements 1s 


| F’(x)| <1 for all xe [a, 5], 


where [a, b] is an interval on which F satisfies the conditions imposed in Note 
(b) above. This condition is certainly satisfied by a linear function with slope 
between —1 and +1 which we considered in Unit 2, section 2.2.4. 


We can establish our assertion as follows. 


Suppose | F’(t)| <1 for all t  [a, 5]. 
Then we may write F’(t) < | F’(t)| <p, where pe R and 0 <p <1. | 
We now integrate the above inequality from a to x, where x € [a, b]. We obtain 


fo— F< [t—p 


By the Fundamental Theorem of Calculus (Unit 5), it follows that 
F(x) — F(@) < p(x — a). 

Putting x =u,_,, F(u,-,) =u, and F(a) = a, we obtain 
Uy, — 4 < P(Uy-1 — 4). 

Hence we obtain 


uy, —a<p**(u, — a), 
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and convergence is established, since 


lim (u, = a) = 0 
k large 


(because lim p* = 0, see section 3.2.1). 
k large 


How do we use this result? The approach is as follows. 
Given an arbitrary equation f(x) = 0, sketch the graph of f so as to obtain some 
idea of the values of the solutions of the equation. Set up an appropriate function 
F so that it satisfies the following conditions: 

(i) Fis differentiable on [a, 5]; 

(ii) |F’(x)| <1 for all x € [a, 5]; 
(iii) F(x) € [a, b] for all x € [a, 5]. 


The iterative sequence will then converge, as required. 


10.2.2 The Newton-Raphson Process 


(a) 


Purpose 


To obtain an approximate method for solving the equation f(x) = 0. 


(b) 


Set Book 


Study section 2.5.3 (pp. 121-122) and complete Exercise 1. 


(c) 
(1) 


(2) 


(3) 


Notes 


The method described is appealing on intuitive grounds for clearly if we are 
“sufficiently close” to a solution of f(x) = 0, then the graphical interpretation 
(p. 121) suggests that the Newton-Raphson method will converge. (All the 
‘‘steps”’ in the iteration are “‘trapped”’ between the curve, the tangent at the 
initial point, and the solution.) However, the derivation tells us nothing about 
the nature of the convergence, nor does it tell us how to find a starting value for 
the iteration which is sufficiently close to the solution we are seeking to ensure 
convergence to this solution. We consider this problem below. 


Another problem comes to light if we examine the form of the recurrence 
formula, 


flu) 


Up+, = Uy Fy 5 
k 


Clearly we shall encounter problems if f’(u,) is zero at one of the points u,. 
When will this occur? We have seen in section 1.8.2 that f’(u,) = 0 implies that 
the tangent to the graph of f is parallel to the x-axis at the point u,. If we are 
already close to a root, then geometrically we can interpret f’(u,) = 0 as implying 
that f(x) = 0 has two, or more, solutions close to the point x = u,. By sketching 
appropriate curves for yourself, you should be able to see that, when the tangent 
to the graph of f is parallel, or nearly parallel, to the x-axis, then the linear 
approximation cannot be used to solve f(x) = 0, because it can lead to a value 
of x for which |u, — x| is very large. | 


In theory, the Newton-Raphson process can be used if u, is close enough to a 
solution of f(x) = 0, and it will fail only if the equation has two or more coinci- 
dent solutions. In practice, you are likely to encounter serious computational 
difficulties if the solutions are simply “‘close”’ rather than coincident. 


We now consider the problem of selecting a satisfactory initial approximation. 
The method to be used is the same as that used for the functional iteration 
problem. That is, we seek conditions on the function f that will enable us to 
identify an interval within which the initial approximation must lie. The labour 
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involved in establishing the appropriate conditions is considerable, and thus not 
appropriate to our introductory course. However, the intuitive meaning of the 
conditions are simple and straightforward, so we shall state the conditions to be 
satisfied, and give some explanation of their significance. 


Let f be a function which is defined and has continuous derived functions, 
f', f”, on an interval J < R. This condition ensures that f is sufficiently “* well- 
behaved ”’ for us to be able to use the quadratic Taylor approximation to discuss 
the behaviour of the terms of the sequence which is generated by successive steps 
in the Newton-Raphson process. 


Suppose that the following conditions are also satisfied on an interval [a, b] ¢ J. 
(i) f(a)f(b) < 0; that is, f(a) and f(b) have opposite signs. 


(This condition ensures that there is at least one solution of f(x) = 0 in 


[a, 5}.) 
(ii) f’(x) £0 for all x [a, 5]. 


(This condition, taken together with condition (i), ensures that there is only 
one solution of f(x) = 0 in [a, b].) 
(iii) Either 
f’(x) 2 0 for all x € [a, 5] 
or 
f"(x) < 0 for all x € [a, 5]. 


(This condition ensures that f’(x) is either increasing or decreasing through- 
out [a, b], which in turn enables us to show that the terms of the sequence u 
are such that either u, >u,_, or uy, <u,-,, thus forming a steady pro- 
gression of closer approximations to the limit.) 

(iv) If c denotes the end-point of [a,b] at which | f’(x)| is smallest, then 


FAG) 
IF'O| 
(This condition ensures that the tangent to the graph of f at the end-point 
intersects the x-axis within the interval [a, b].) 


<b—a. 


Under this set of conditions, the Newton-Raphson method converges to the 
(only) solution of f(x) =0 in [a,b] for any choice of initial approximation 
x, € [a, 5}. 


These conditions are sufficient but not necessary; convergence can be established 
for weaker sets of conditions. In practice, to use this result we must first sketch 
the graph of f and use it as a basis for selecting an interval which we can then 
show satisfies the conditions specified. 


One final point: although we derived the Newton-Raphson formula by a dif- 
ferent technique to the basic functional iteration method (described in Unit /, 
section 1.2.4), it does not represent a radically different idea. If you compare the 
solution of Exercise 1 of section 2.5.3 (p. 146) with Exercise 2 of section 1.2.4 
(p. 35), you see that the iteration formula which we established in both cases is 
identical. This observation underlines the fact that we can use many different 
methods to set up an iterative process to solve the equation f(x) = 0; for example, 
we would obtain yet another formula if we were to approximate the graph of /, 
near to a solution, by a chord rather than a tangent, and so on. 
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10.2.3. Power Series 


(a) Purpose 


To explain what is mean by a power series and the sum of a (convergent) power series, 
and to give the (convergent) Maclaurin expansion of some standard functions. 


(b) Note 


We introduced the concept of an infinite series and defined the meaning of the sum of 
a convergent infinite series in section 3.2.3 of Unit 3. We advise you to revise (or work 
through) that section before studying the material specified below. 


(c) Set Book 


Study section 2.5.8 (pp. 139-144), and complete the exercises. (You completed Exer- 
cise 1 when you studied section 3.2.3 in Unit 3.) Omit Exercise 4 if you are short of 
time. 


(d) Notes 


(1) Insection 3.2.3 of Unit 3 we dealt mainly with infinite series that did not contain a 
variable. The exception was the geometric series 


l+rtr +: 


We have seen that this series converges to the sum 1/(1 — r) if |r| < 1 and that it 
diverges if |r| > 1: that is, the convergence depends on the value of the variable r. 


In section 2.5.8 we discuss this more general type of infinite series in which a 
variable element is involved. The series 


Ag t+ayxtan,x*+... (xER) 
is called a power series, because it is composed of powers of the variable x. When 
a fixed value is assigned to x, the power series reduces to the type of infinite 
series discussed in Unit 3. Thus a power series may be convergent for some values 


of x and divergent for other values of x. Since the sum of a convergent power 
series depends on x, it is denoted by S(x) to show that it is a function of x. 


(2) Exercise 2, and its solution (pp. 141 and 153-154) illustrates the link between the 
Taylor (Maclaurin) approximation discussed in section 10.1.3 and the mathe- 
matics of infinite series. 


If the function / has derivatives of any order, then the result of Exercise 2 tells 
us that, if the power series 


{@+f'@x«-a+if"@x-a’?+-:- (MER) 


has the property that lim C,(x) = 0, then it converges to f(x). 
k large 


We call such a series the Taylor series (expansion) for the function f at the point a; 
if a is zero, then we call the series the Maclaurin series (expansion) for f. Some 
examples of Maclaurin series are given on page 143. It can also be shown that, 
if the power series 


bo + by(x — a) +b,(x — a)? + °°: 
converges to f(x), then the series is the Taylor series for f at the point a; that is 


l 
Seer 


(C.f. Note c(2) of section 10.1.1 and Note c(1) of section 10.1.2.) 


(3) In section 3.2.5 of Unit 3, we discussed the problem of summing infinite series, 
and described some simple tests for determining whether a particular series is 
convergent or divergent. The techniques described there can be applied to the 
problem of summing power series. We see from Note (2) above, that we may 
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be able to obtain the sum of the series directly (by recognizing f) if we can 
establish that the series is absolutely convergent. We would like to be able to 
determine the values of x for which a given power series is absolutely convergent. 
For simplicity, we can consider a power series in the form 


Ay + A,X + a,x? +°°°, 

since the more general form 
by + bi(x — a) + b,(x — a)* + °°: 

can be regarded as a power series in the variable 
X=x-a. 


We can obtain a test for absolute convergence by making use of the ratio test 
described in section 3.2.5 (f) of Unit 3. We consider the ratio of two successive 
terms in the series. The result to be used can be stated as follows: 

If the series 


fy ety t,t 
is such that c,.,/c, 1S defined for all n and 


Cnt+1 


Cn 


lim 


n large 


a J. 


then 
if L < 1, the series is absolutely convergent; 
if L > 1, the series is divergent; 


if L = 1, the test gives no information about the convergence of the 
series. 


If we apply the ratio test described above to the power series 
Ay + AX + a,x? +°°°, 
then the condition for absolute convergence is 


Qn+1 
a, 


lim 


n large 


Pe PSE, 


where a,, # 0. 


If there exists a number r > 0 such that } a,x” converges absolutely for |x| <r 
and diverges for |x| >r, then r is called the radius of convergence of the power 
series, and the interval |] — r,r[ is called the interval of convergence. Notice that 
the ratio test leaves us with an open interval, since the test 1s inconclusive when 
|x| =r. The behaviour of the series for x = +r requires separate investigation. 
If the series is absolutely convergent for a// values of x, then the radius of con- 
vergence is said to be infinite. 


In section 2.5.8, we have used an alternative criterion to establish convergence, 
based on the result of Exercise 2 (pp. 141 and 153-154); we examine the values 
of x for which 
lim C,(x) — 0, 
k large 

where C,(x) is the correction to an expansion. This test gives us the results 
summarized on page 143. To apply this result, we often make use of the estimate 
for C,(x) derived in section 2.5.7. 


(e) Self-Assessment Questions 


Investigate the convergence of the following power series: 


5 eee eee 
1 _—_—= pean eee SS 
tee eee 
2 gt 
ee eee eae 
ee Se aes 
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2 3 


x 
3 Beata tat 

See aes 
Solutions 


<= pone Sy bale 
1 The series is a geometric series with common ratio — os 


The series is absolutely convergent if 
<j. 16 xel=./2./ 21. 


If x = +,/ 2, the series is divergent. 


x? 


2 The nth term in the series is (— 1)"**x"/n. Using the ratio test, we obtain © 


; a < 
lim | + ||x| = lim |x| 
nlarge| Gy nlarge 1 1 
= 1x] lin 
steep + 1 
as bf. 


Therefore the series is absolutely convergent for |x| <1; that is, the radius of 
convergence is 1. For |x| < 1, the series is the Maclaurin series for the function 


fix-—— In(1 +x) (x €]—1, 1f). 
It can be shown that the series converges for x = 1 and diverges for x = —1. 


3 The nth term in the series is x"~*/(n — 1)! 
Using the ratio test, we obtain 


a n—1)! 
lim | = ||x| = lim ( |x| 
n large an n large n! 
Ee 
= |x| lim —- 
n large 
xe1x| x 0 


== Q). 
Therefore the series is absolutely convergent for all values of x. 
The series is the Maclaurin series for the exponential function. 
4 Thenth term in the series is (— 1)"*1x?"~1/(2n — 1)! Using the ratio test, we obtain 


 (Qn—1)! 
= lim ——— 
n large (2n + 1)! 


Cat+1 


Cn 


lim |x|? 


n large 


|x|? 


lim ———— 
J an + DD 
= |x|7x 0. 
Therefore the series is absolutely convergent for all values of x. 


The series is the Maclaurin series for the sine function. 


(f) Terminology 
Defined in this section: 


power series 

Taylor series (expansion) 
Maclaurin series (expansion) 
radius of convergence 
interval of convergence 


25 


MST281 10.2.4 


10.2.4 Taylor’s Theorem 


(a) Purpose 
To demonstrate Taylor’s theorem; that is, to show that the condition 
fs <8 Gel 


is sufficient to imply that the correction associated with the Taylor expansion of a 
function f at the point a satisfies the inequality 


|Ci(x)| me |x —al?™. 


n+ 1)! 


(b) Set Book 
Study section 2.5.7 (pp. 134-138) and complete Exercise 1. 


(c) Notes 


(1) The method used to demonstrate the general Taylor theorem is a simple general- 
ization of that used to demonstrate the Taylor theorem for linear approximations 
(section 10.1.4). 


(2) Remember that the importance of this theorem is that it enables us to estimate the 
maximum error involved when we approximate a function by a Taylor (or 
Maclaurin) expansion. 


(d) Self-Assessment Question 


In the Maclaurin approximation of degree n for f: x ———> e*, how large does n 
have to be for the error in the approximation for e to be less than 0.001 ? (Assume that 
é = 2.71828 «..) 


Solution 

e* increases steadily as x increases, and f(x) = e” for all x. So in the interval [0, 1], 
fOr D1) <e. 

It follows that 


e 
(n+ 1)! 
__ 2.71828 
(n+)! 


We find that, if we take the Maclaurin approximation of degree 6, and substitute x = 1, 
the error in the value we obtain for e is less than 0.001. 


error = C,(1) < (1 —0)"*! 


(e) Terminology 
Defined in this section: 


Taylor’s theorem 


26 


MST281 10.2.5 


10.2.5 Maxima and Minima of Functions of Two Real Variables 


In this section, we return to the problem of the determination of local extrema of 
functions of two real variables, which we introduced in Unit 7, section 7.1.7. We use 
the Taylor series for a function of one real variable to construct a test which enables 
us to determine the nature of such extrema in certain cases. 


So far in this unit we have written the Taylor series about x = a in the form 
f(x) =f{@+%-Of'@+ie-*AS’@+:", 


that is, as an expression for f(x), where x is “near” a particular point a. We now wish 
to use this result in the more general form 


f(x +h) =f(x) + hf'(x) + SH°F"(X) +7, 
that is, as an expression for the image under f “‘ near” the general point x. 


Let F be a real function of the two real variables x and y. We shall assume that F has 
continuous partial derivatives of order 1, 2, 3, 4 with respect to x and y (alone or com- 
bined). 


We define F(a, b) to be a local maximum (minimum) value of F(x, y) if 
Fat+h,b +k) — F(a, b) 3 
is negative (positive) for all small independent values of h and k. 


We now use the Taylor series for a function of one real variable to investigate the 
sign of F(x + h, y +k) — F(x, y). We do this by treating F as a function of each real 
variable in turn, the other variable being held constant. This means that the derivatives 
in the Taylor series will be partial derivatives. (See Unit 7, section 7.1.4.) 


We shall adopt the following notation. We shall denote 


OF 
F‘(x, y) or ay by F,(x, y), 
b 4 


OF 
F(x, y) or y by F,(x, y), 


67°F 

Ay OY Fasl™ Y) 
06°F 

F42(x, y) Or ay? OY Fee, y), 


110%; y) or 


02F 
F(x, y) or ay Ox by Foams y)s 
2 


ioe ae 
F41(x, y) Or ax Oy by Fi X y), 


and so on. 
The conditions which we have assumed F to satisfy are sufficient to ensure that 
Fg @ Pe 


We begin by considering y and k as constants and treating F as a function of x alone. 
Using the Taylor series, we obtain 


Fixthyt+th=Fxyytkh+hF(xyt+kht+4WF(%ytkh+:: (i) 


We now treat x as constant, and treat F as a function of y alone. Using the Taylor 
series, we obtain 


F(x, y + k) = F(x, y) + KF,(x, y) + 3k7F,,(x, y) + °°" (ii) 
We now take equation (ii) and replace F by F,, to give 
F(x, y +k) = F(x, y) + KF,,(x, y) + 4k°F,y.(x, y) + °° (iil) 
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Similarly, replacing F in (ii) by F,.., we obtain 
F(X, ¥ + k) = Fy. Y) + KF y(%, Y) + Hh Fy ex(% Y) + °° (iv) 
Substituting equations (ii), (iii) and (iv) in equation (i), we obtain 
F(x +h, y +k) = F(x, y) + kF,(x, y) + hF,(x, y) 
+ 4k*F,,(x, y) + AKF,,(x, y) 
+ $h°F (x, y) +" 
Thus 
F(x +h, y +k) — F(x, y) = kF,(x, y) + hE, y) 
+ 4[k*F,,(x,y) + 2AkF,,(x, y) + h7F,,(x,y)] + °°° 
Nov, if 4 and k are sufficiently small, the sign of 
F(x +h, y +k) — F(x, y) 
is the sign of 
kF,(x, y) + hF,(x, y). 


The last expression changes sign with the signs of / and k, so a necessary condition for 
(a, b) to be a local maximum or a local minimum is 


KF,(a, b) + hF,(a, 6) = 0 for all h, k; 
that is, 
F(a, b) = F,(a, b) = 0. 
When this condition is satisfied, the sign of 
Fia+h,b+k) — Foa, b) 
is the sign of 
k?F,,(a, b) + 2hkF,,(a, b) + h?F,,,(a, b). 


Thus, for a local maximum or minimum, this expression must have the same sign for 
all small values of h and k. Writing 


A = F,,(a, b), 
B = F,,(a, b), 
C = F(a, b) 
and completing the square, we obtain 
Al(e+20)' + (4252 )].a40, 
The sign of this expression is the same as the sign of A, provided that AC — B? > 0 
and / and k are not both zero. 
Let us assume that AC — B? > 0, that is, 
F,,(a, b)F,.(a, b) — (F,,(a, b))? > 0. 
Then 
F(a+h,b +k) — F(a, b) > 0 if F,,(a, b) > 0 
and 
F(a +h,b +k) — F(a, b) <0 if F(a, b) <0. 
Thus we have the following test: 
If (a, b) is such that 
F(a, b) = F(a, b) = 0 
and 
F,,(a, b)F,.(a, b) — (F(a, b))” > 0, 
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then 
(a, b) is a local minimum if F,,(a, b) > 0, 
(a, b) is a local maximum if F,,(a, b) < 0. 
Note that, by symmetry, the last two lines may be replaced by 
(a, b) is a local minimum if F,,(a, b) > 0, 
(a, b) is a local maximum if F,,(a, b) < 0. 


This is the form of the test given in Unit 7, section 7.1.7. 
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10.3 SUMMARY 


In this unit we have considered the Taylor approximation in some detail. 


When you have completed work on the core material, you should be able to write down 
the general Taylor approximation to f(x) about the point x = a in the domain of f, 
for a suitable function f You should also be able to give an upper bound on the error 
when the tangent approximation is used. 


The optional material extends the work of earlier units. 
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ELEMENTARY MATHEMATICS FOR SCIENCE AND TECHNOLOGY 


ee 
ANN PWNK OO OADM PWN 


Sets, Mappings and Sequences 
Functions and Limits 

The Definite Integral 

Differentiation 

The Fundamental Theorem of Calculus 
NO TEXT 

Optimization Problems 

Techniques and Applications of Integration 
Operations and Relations 

Taylor Approximation 
Morphisms—Geometric Vectors 

NO TEXT 

Vector Spaces— Matrices 

Differential Equations 

Linear Equations 

Complex Numbers 

Second Order Differential Equations 
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